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Glossary 

Bose-Einstein Condensation (BEC) 

Low temperature phase of systems of identical bosons, characterized by superfluidity. 
Boson 

Particles with integer spin S = 0,1,2,.... Mediators of interactions, such as photons and 



gluons are bosons. Objects made of an even number of fermions are bosons: positroniun 
(electron + positron), meson (two quarks), ^^Rb (37 protons, 48 neutrons and 37 electrons), 
'^Li (3 protons, 4 neutrons, 3 electrons). 

Cooper pairs 

At low temperatures and for attractive interactions fermions form a superconducting state, 
in which fermions form pairs which condense. 

Fermi surface 

Since fermions obey Pauli's exclusion principle, the ground state of non-interacting fermions 
in d-dimensions is the state with the lowest energy states occupied. In momentum space 
the last occupied state and the first unoccupied state define a surface of dimensions d — 1, 
called the Fermi surface. 

Fermion 

Particles with half-odd integer spin 5* = |,|,|,.... Examples include elementary particles 
such as electrons and quarks. Objects made of an odd number of fermions are also fermionic, 
such as protons, (19 protons, 21 neutrons, and 19 electrons), and ^Li (3 protons, 3 neu- 
trons, and 3 electrons). 

Laser Cooling 

In a typical experimental setup, the atoms are cooled to the regime of 10'^ fiK, by using pairs 
of counterpropagating laser beams that are slightly red-detuned below an atomic transition. 
Due to the Doppler effect the atoms can only absorb a photon if they travel towards the 
beam with a high velocity. From that process the atoms experience a recoil, which slows 
them down. 

Evaporative Cooling 

To slow the atoms down further, to the fiK regime, one applies radio frequency radiation 
that flips the internal state to a high-field seeking, i.e. non-trapped, state in such a way, that 
only atoms of high kinetic energy can escape. Due to thermalization, this leads to cooling 
of the remaining atomic ensemble. 

Magnetic Trap 

The atoms are trapped by applying a spatially inhomogeneous magnetic field. This field 
leads to an energy shift due to the Zeeman effect, which the atoms experience as an external 
potential, for large energy splittings of the magnetic levels. Different geometric designs are 
in use, such as the TOP trap, or the loffe-Pritchard trap. 

Optical Lattice 

Counterpropagating laser beams create a standing wave field, which the atoms experience as 
a periodic potential, due to the ac Stark shift. If the temperature and all energy scales are 
small compared to the energy splitting due the spatial confinemenent in each well, this sys- 



tern is well approximated by a Hubbard model, i.e. by taking into account nearest-neighbor 
hopping and on-site interaction. 

Nesting 

Fermi surface with portions that are parallel. The vector that connects different parallel 
portions is called the nesting vector Q. 

I. Definition of the Subject and Its Importance 

The work presented in this article belongs to the recently emerging interface of atomic 
physics and condensed matter theory. One of the crucial connections between these fields is 
the fact that ultracold atom ensembles in optical lattices, i.e. periodic potentials provided 
by standing waves of laser light, are well described by Hubbard models, the quintessential 
model of many-body theory. Therefore, these experiments allow for the study of many-body 
effects in a well-defined and tunable environment. 

The subject of this article is the study of quantum phases of ultracold atoms in optical 
lattices. The objective is to propose experimental configurations, such as what lattice ge- 
ometry or which types of atoms to use, for which unusual many-body effects can be found. 
Besides the applicability to ultra-cold atom systems, and given the generic nature of the 
underlying models, the resulting phases are also of interest in solid state systems. 

Using techniques such as a numerical implementation of functional renormalization group 
equations and Luttinger liquid theory, we find the phase diagrams of various low-dimensional 
systems of different geometry, and discuss how the various phases could be detected. 

II. Introduction 

The technology of cooling and trapping atomic ensembles has been one of the most important 
developments in physics over the last decades. It has been a critical ingredient in creating 
Bose- Einstein condensates (HE], improving atomic clocks [51], and studying atomic prop- 
erties [HDlllS]- A new direction in this development was the realization of the Mott insulator 
transition [30] with ultra-cold atoms, which demonstrated that these systems can be used 
to create various types of quantum phases in a tunable and well-defined environment. The 
subsequent progress that has been made in controlling and manipulating ensembles of ultra- 
cold atoms [971 ESI EH |57], was followed by a number of experiments to create and study 
more and more sophisticated many-body effects, such as fermionic superfiuids [31], HS], 1114] , 
one-dimensional strongly correlated Fermi and Bose systems [82l [52] [75] , or noise correlations 
in interacting atomic systems [3l [66] [32|, [21] . These developments established the notion 
of 'engineering' many-body states in a tunable environment, i.e. manipulating ensembles of 
ultra-cold atoms in optical lattices. 

This article further explores this development. The first step of creating novel states 
of matter is to determine the phase diagram of the system under consideration. For this 
purpose we use Luttinger liquid theory for studying one-dimensional quantum systems and 



two-dimensional thermal systems, and functional renormalization group equations to study 
two-dimensional quantum systems, which are both sophisticated methods that generate a 
lot of insight into the physics of these systems. 

This article contains three main sections, which can be read independently of each other, 
organized as follows: in Section III we first study the phase diagram of an incommensurate 
Bose-Fermi mixture in one dimension, which can be understood as a Luttinger liquid of 
polarons (see [65l |69]). We then broaden the scope of this study to include the effects of 
commensurate densities (see [68]). In Section IV, we study the phases of two coupled two- 
dimensional superfluids, and we propose how the phase-locking transition of such systems 
can be used to realize the Kibble-Zurek mechanism, i.e. to create topological defects by 
ramping across a phase transition (see [71]). In Section V, we use a numerical implementation 
of functional renormalization group equations to study the phase diagrams of Bose-Fermi 
mixtures in optical lattices in two dimensions. For both a square and a triangular lattice we 
find a rich structure of competing phases (see [HZl EOl 

III. One-Dimensional Lattices 

The theory of one-dimensional many-body systems has been a highly active and fascinating 
field of physics for many decades, the centerpiece of which is the notion of the Luttinger 
liquid [25l ETJ [95]. In this section we propose several systems that display various features of 
Luttinger liquids, such as quasi-long range order, competing orders, and Kosterlitz-Thouless 
transitions due to commensurate densities, as will be explained. 

Recent advances in controlling ultra cold atoms lead to the realization of truly one di- 
mensional systems, and the study of many-body effects therein. Important benchmarks, 
such as the Tonks- Girardeau gas [521 [S2] and the Mott transition in one dimension |9 7], have 
been achieved by trapping bosonic atoms in tight tubes formed by an optical lattice poten- 
tial. Novel transport properties of one dimensional lattice bosons have been studied using 
these techniques |20]. More recently, a strongly interacting one dimensional Fermi gas was 
realized using similar trapping methods[7S]. Interactions between the fermion atoms were 
controlled by tuning a Feshbach resonance in these experiments. On the theory side, numer- 
ous proposals were given for realizing a variety of different phases in ultra cold Fermi systems 
[Ha [221 [10], Bose-Fermi mixtures[9l [65l [691 [^ , as well as Bose-Bose mixtures [M 1^. 

In the first part of this section, we describe the phase diagram of an incommensurate 
Bose-Fermi mixture, in the second part we consider the effect of commensurate fillings. 

Luttinger liquid of polarons in one-dimensional Bose-Fermi mix- 
tures 

In this section we investigate one dimensional (ID) Bose-Fermi mixtures (BFM) using 
bosonization [35l [8] . The resulting quantum phases can be understood by introducing po- 
larons, i.e. atoms of one species surrounded by screening clouds of the other species. In 
our analysis the polarons emerge as the most well-defined quasi-particles in the interacting 
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Figure 1: Phase diagram for a mixture of bosonic and spinless fermionic atoms in a ID 
optical lattice. Shading in the /-PP phase describes the strength of the bosonic screening 
cloud (2A, see Eq.(j4])) around a pair of fermions. Xl and Er are respectively the lattice 
period and recoil energy. Other parameters used for this figure are (see text for notations, 
for details): Ub = 4, z^/ = 0.5, Vb^± = Vf^± = 20Er, V/jj = 2Eji, boson-boson scattering 
length ttbb = O.OIAl. 

system while quantum phases of the system arise from a competition of various ordering 
instabilities of such polarons. The phase diagrams we obtain show a remarkable similarity 
to the Luttinger liquid phase diagrams of ID interacting electron systems [HSlllZl, suggesting 
that ID BFM may be understood as Luttinger liquids of polarons. 

To illustrate the results of this section, we show a typical phase diagram for a BFM in an 
optical lattice in Fig. [H as a function of experimentally controlled parameters. We consider 
two types of atoms, one fermionic and one bosonic, moving in a lattice potential with the 
amplitude Vb,\\ (see jSH]), and interacting via a short-ranged interaction characterized by the 
scattering length a^j between bosons and fermions. We use these parameters, the scattering 
length ttbf and the strength of the longitudinal optical lattice for bosonic atoms (H,||) [H], as 
tuning parameters in Fig. [TJ For relatively weak interactions and slow bosons (i.e. large Vb^\\) 
the system is in the charge-density-wave (CDW) phase, in which the densities of fermions and 
bosons have a periodic modulation [TH] . For very strong interactions the system is unstable 
to phase separation (PS) 0,[I1[7]. The two regimes are separated by a p-wave pairing phase 
of fermionic polarons (/-PP). Our analysis is carried out for the most promising system of 
atoms in an optical lattice. However, qualitative results should also apply to atoms in a 
tight ID cigar-shaped magnetic trap [26]. A sketch of the two phases is shown in Fig. [2l 

The essence of the bosonization procedure is to diagonalize the effective low-energy Hamil- 
tonian, which allows for the exact calculation of all relevant correlation functions. The phase 
diagrams are determined by finding the order parameter which has the most divergent sus- 
ceptibihty [951117]. Bosonization approach has been applied to BFM in Ref. [9]. However, 
that work did not consider the formation of polarons and, as a result, did not describe most 
of the quantum phases discussed here. The present system also has a close analogy to ID 
electron-phonon systems discussed previously (see e.g. Ref. |lU7j ). A qualitative difference 



of the electron-phonon system is that the sound velocity is usually much smaller than the 
Fermi velocity, whereas for a BFM the velocity of the phonon modes (of the bosonic con- 
densate) can be larger than the Fermi velocity. We also note that the 1-D p-wave superfluid 
we obtain here may be of relevance to a recent proposal for quantum computation [53] . 

We now give an overview over the, somewhat technical, derivation of this phase di- 
agram, before we discuss issues concerning the experimental realization and detection of 
these phases, and conclude. We consider a mixture of spinless fermionic (/) and bosonic (b) 
atoms. For a sufficiently strong optical potential the microscopic Hamiltonian is given by a 
single band Hubbard model 



H = -^(hblbj+tffjfj) -^{fifnf^i + fimbA) + ^^nb,i{rib,i-'^) + UbfY^ 
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where are the boson/fermion density operators with fif,/f being their chemical po- 

tentials. The tunneling amplitudes tj/^, and the particle interactions Ub and Ubf can be 
expressed explicitly in terms of the s-wave scattering lengths, the laser beam intensities and 
atomic masses [12]. For simplicity we assume that the filling fraction of fermions Uf = (fif^i) 
is not commensurate with the lattice or with the filling fraction of bosons z/^. Therefore, 
we can neglect lattice- assisted backward/Umklapp scattering. The Fermi momentum and 
velocity are given by kf = nuf and Vf = 2tf sm{kf), respectively. 

In Haldane's bosonization approach [35118] ID fermion and boson operators can be repre- 
sented by f{x) = [uf + Uf]^/^ Em=-oo e(2"^+^)^®/e^*/ and b{x) = [vb + ^bY'^ Y.Z=-oo e^'^^^'f^^" 
where x is a continuous coordinate that replaces the site index i. The operators 11//;, (x) and 
are the bosonized density and phase fluctuation operators. The 6//b(x) fields are 
given by Q^jb = T^i^f/bX + tt J dyllf/b{y). The low-energy effective Hamiltonian thus can be 
written as: 



(2) 



a=bj 



where Vb and Kb are the phonon velocity and Luttinger exponent of the bosons and Kf = 1 for 
noninteracting fermion atoms. To obtain the last term of H^s we have integrated out the high 
energy {2kf) phonons within the instaneous approximation (i.e. assuming Vb ^ f/). G = 

■^^■1 where ujk is the (Bogoliubov) phonon energy dispersion |104j and gt = Ubf^/i^b ^b,k/'^'^^k 

is the fermion-phonon (FP) coupling vertex with Sb^k being the noninteracting boson band 
energy. In the long wavelength limit we have a conventional FP coupling = g\k\^^'^ with 
g = Ubf\/Kb/27r. The effective Hamiltonian, Eq. ([2]), is quadratic and can be diagonalized 
[T7] . The resulting two eigenmode velocities are given by [9] 

O 1/0 ~0\ , 1 
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vt + vj) ± -J{vl - dj)^ + 16^ W'/, (3) 



where Vf = {vj - AC^f^ and g = g with = {{vf - 2G)/{vf + 20)^/^ When the 
FP coupling g becomes sufficiently strong the eigenmode velocity va becomes imaginary. 
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Figure 2: Illustration of the two phases that occur in a BFM with spinless fermions, CDW 
and /-PP. In the CDW phase the system develops a. 2kf density modulation in both the 
fermionic and the bosonic liquid. In the /-PP phase, the fermions form polarons, indicated 
by the reduced bosonic density in their vicinity, that is, their polarization cloud. This 
polarization leads to an effective attractive interaction, which causes these fermionic polarons 
to pair up and form a superfluid state. 



indicating an instability of the system. This instability corresponds to phase separation 
(global collapse) for positive (negative) f/6/[9]. 

To understand the nature of the many-body state of BFM outside of the instability region 
we analyze the long distance behavior of the correlation functions. For the bare bosonic and 
fermionic particles we find {b{x)b^{0)) ~ \x and (/(x)/t(0)) ~ cos(A;/x)|x|-2(^'3+-^^ ) 

[T5] . To describe particles dressed by the other species we introduce the composite operators 

/(x) = e-*^*'(")/(a;), h{x) = e-'''''f^%{x), (4) 

with A and rj being some real numbers. The correlation functions of these operators are given 
by (/(x)/t(0)) ~ cos{kfx)\x\~^^^^+^'^^'+^'^'-^^^^''> and {b{xp{0)) ~ \x\~Uk^"+^'k^'-^^^^") 
[T5] . We observe that the exponents of the correlation functions are maximized for Ac = 
K^l K^^ and rjc = K^/K^^. From now on we will use Eq. (jlj) with Ac and ?7c to construct po- 
laronic particles. In the limit of weak interactions we have Ac — > Uf,f/Ub and r]c 2Ubf/7rVb. 
This result can be understood by a simple density counting argument that a fermionic po- 
laron (/-polaron) locally suppresses (enhances) a bosonic cloud by Ac particles, whereas a 
bosonic polaron (6-polaron) depletes (enhances) the fermionic system by r]c atoms for positive 
(negative) g. 

The polaronic operators defined in Eq. (jl]) can also be introduced via the canonical 
polaron transformation (CPT), which is often used in polaron theory [021 [2]. The CPT 
operator is given hy U = e~*'^^'=7^o(^''^'=''''"'"'^'^')^ where (3k is the phonon annihilation operator, 
Pk is the fermion density operator, Fk is some function of wavevector k, and A specifies the 
strength of the phonon dressing. When applied to a fermion operator, the CPT transforms it 

to a polaron operator, U~^f{x)U = /(x)exp —i^J^ky^o {^kPh^''''''^ + ^-c.) [621 [2], which 



is the same as Eq.(jlD, provided that one takes = ^/ j^^^sgn{k). (Note that in ID 



Figure 3: Ground state of a BFM with spinless fermions. (a) Scaling exponents of different 
order parameters (see the text). Parameters are chosen to he Vb/vf = 3, Kb = 5 and 
G/vf = 0.1. (b) Global phase diagram for Vb/vf = 5 and Kb = 10. Shading density indicates 
the strength of the screening clouds of a polaron pair, 2Ac. 

fermionic systems density operators correspond to Luttinger bosons.) We note, however, 
unlike in ordinary polaron theory, where further approximations after the CPT have to 
be made [62l [2], in the ID BFM system we consider here, the full low energy quantum 
fluctuations have been included via bosonization method and exact diagonalization of the 
resulting Hamiltonian Eq. ([2]). This allows for an essentially exact determination of the 
polarization parameter A. 

Now we study the many-body ground state phase diagram of a ID BFM, which is char- 
acterized by specifying the order parameters that have the slowest long distance decay of 
the correlation functions [951 HZ]- Two types of ordering were found to occur: 2A;j-ordering 
due to a Peierls-type instability and /-polaron pairing due to their effective attractive inter- 
actions induced by the screening clouds. For the 2k f CDW order parameter, Ocdw = flfR^ 
we find acnw = 2 — 2i^^, and for the /-polaron pairing field, Of^pp = fifR, we obtain 
af-pp = 2 — 2 [XlK~^ + K~^ — 2\cK~^~\ . We did not include polaron dressing in Ocdw, 
since this operator has no net fermionic charge and the exponent of Ocdw does not change 
if we replace / by /. Scaling exponents shown in Fig. [3]^a) demonstrate that divergencies of 
the CDW and /-PP susceptibilities (corresponding to positive a) are mutually exclusive and 
cover the entire phase diagram outside the PS regime. In the same figure, we also show the 
scaling exponents calculated for bare fermion pairing {Obfp = fifR), bare boson condensate 
{Obb = b), and 6-polaron condensate (Of,_p = b). It is easy to see that the polaronic or- 
der parameters always have larger exponents than their counterparts constructed with bare 
atoms, showing the stability of polaronic quasi-particle in a ID BFM system. Moreover, the 
necessity to consider /-polaron pairing instead of bare fermion pairing is further supported 
by considering the stability of superfluidity: we introduce a single weak impurity potential in 
the ID BFM and determine its relevance by a renormalization group (RG) calculation [38]. 
We find that the impurity potential is relevant within the CDW phase and irrelevant outside 
of it. This indicates that there should be a superfiuid phase outside of the insulating CDW 
phase , which supports the existence of /-polaron pairing instead of bare fermion pairing 
according to Fig. ^a). 

In Fig. [3](b) we show a global phase diagram of a BFM considering the FP coupling 



(g) and effective fermion-fermion interaction (G) as independent variables. One can see 
that the polaronic effects and the associated pairing phase are important when FP couphng 
[g) is large, while the CDW phase dominates when the effective fermion interaction (G) is 
increased. This phase diagram is very similar to what one finds for spinless electrons in 
Luttinger liquid theory [951 HZ]; where CDW and pairing phase compete with each other 
in the whole phase diagram. Therefore one can introduce a Luttinger liquid of polarons 
to describe BFM in ID systems. The phase diagram in terms of experimentally controlled 
parameters was shown in Fig. [H When considering finite temperature effects in a realistic 
experiment, we note that the correlation function is cut-off by thermal correlation lengths, 
which are approximately given by ^ ~ Vf/kBT. Therefore the zero temperature ground 
states should appear when ^ > L with L being the system size. This corresponds to a 
temperature regime of 1% of the Fermi temperature for systems of approximately 100 sites 
in the longitudinal direction. 

Several approaches can be used to detect the quantum phases discussed above. First, in 
the CDW phase the fermion density modulation will induce a density wave in the boson 
field in addition to the zero momentum condensation so that the CDW phase can be observed 
as interference peaks at momentum k = 2kf in a. standard time-of-flight (TOF) measurement 
for bosons [19]. Secondly, the polaron pairing phase can be observed by measuring the noise 
correlation of fermions in a TOF experiment as proposed in Ref . [3] . Thirdly, a laser stirring 
experiment [TTJ EZ] can be used to probe the phase transition between the insulating (pinned 
by trap potential) CDW and the superfluid /-PP phase: one can use a laser beam focused 
at the center of the cloud and stir such local potential to measure the response of the BFM. 
If the system is in the pairing phase, the laser beam can be moved through the system 
without dissipation if only its velocity is slower than some critical value [TTJ [87]. At the 
/-PP/CDW phase boundary this critical velocity goes to zero, reflecting a transition to the 
insulating (CDW) state. This scenario follows from the above described RG analysis of a 
single impurity potential [H]. Finally a way to probe the PS boundary could be to measure 
the dipolar collective oscillations of the system, generated by a sudden displacement of the 
harmonic trap potential with respect to the lattice potential [611 IMl 1106] . When the system 
is near the PS boundary, fermion-boson interaction will strongly reduce the frequency of the 
dipolar mode. 

In summary, we used bosonization to investigate the quantum phases of ID mixtures of 
bosonic and fermionic atoms involving spinless fermions. The phase diagram that we found 
can be understood in terms of a Luttinger liquid of polarons. We also described several 
experimental techniques for probing these quantum phases. 

Commensurate mixtures of ultra-cold atoms in one dimension 

In this section we explore the behavior of ultracold atomic mixtures, confined to one- 
dimensional (ID) motion in an optical lattice, that exhibit different types of commensu- 
rability, by which we mean that the atomic densities and/or the inverse lattice spacing have 
an integer ratio. Commensurable fillings arise naturally in many ultracold atom systems, 
because the external trap potential approximately corresponds to a sweep of the chemical 



potential through the phase diagram, and therefore passes through points of commensu- 
rabihty. At these points the system can develop an energy gap, which fixes the density 
commensurability over a spatially extended volume. This was demonstrated in the cele- 
brated Mott insulator experiment by Greiner et al.[30], where Mott phases with integer 
filling occurred in shell-shaped regions in the atom trap. These gapped phases gave rise 
to the well-known signature in the time-of-flight images [TOO] , and triggered the endeavor of 
'engineering' many-body states in optical lattices. Further examples include the recently cre- 
ated density-imbalanced fermion mixtures [831 1115] in which the development of a balanced, 
i.e. commensurate, mixture at the center of the trap is observed. 

In ID, this phenomenon is of particular importance, because it is the only effect that 
can lead to the opening of a gap, for a system with short-range interactions. In contrast to 
higher dimensional systems, where, for instance, pairing can lead to a state with an energy 
gap, in ID only discrete symmetries can be broken, due to the importance of fluctuations. 
Orders that correspond to a continuous symmetry can, at most, develop quasi long range 
order (QLRO), which refers to a state in which an order parameter 0{x) has a correlation 
function with algebraic scaling, (O(x)O(O)) ~ Ixl"*^^""-*, with a positive scaling exponent a. 

Due to its importance in solid state physics, the most thoroughly studied commensurate 
ID system is the SU(2) symmetric system of spin-1/2 fermions. This system develops a 
spin gap for attractive interaction and remains gapless for repulsive interaction, as can be 
seen from a second order RG calculation. However, the assumed symmetry between the two 
internal spin states, which is natural in solid state systems, does not generically occur in 
Fermi- Fermi mixtures (FFMs) of ultra-cold atoms, where the 'spin' states are in fact different 
hyperfine states of the atoms. An analysis of the generic system is therefore highly called 
for. Furthermore, we will extend this analysis to both Bose-Fermi (BFMs) and Bose-Bose 
mixtures (BBMs), as well as to the dual commensurability, in which the charge field, and 
not the spin field, exhibits commensurate filling, as will be explained below. 

The main results of this section are the phase diagrams shown in Fig. H] and [S] We find 
that both attractive and repulsive interactions can open an energy gap. For FFMs the entire 
phase diagram is gapped, except for the repulsive SU(2) symmetric regime (cp. jlO]), for 
BFMs or BBMs the bosonic liquid(s) need(s) to be close to the hardcore limit, otherwise 
the system remains gapless. Furthermore, we find a rich structure of quasi-phases, including 
charge and spin density wave order (CDW, SDW), singlet and triplet pairing (SS, TS), 
polaron pairing [651 EH], and a supersolid phase, which is the first example of a supersolid 
phase in ID. These results are derived within a Luttinger liquid (LL) description, which 
treats bosonic and fermionic liquids on equal footing. 

We will now classify the types of commensurability that can occur in a system with 
short-ranged density- density interaction. We consider Haldane's representation [35118] of the 
densities for the two species: 




(5) 



m. 



Ui and 1^2 are the densities of the two liquids, 111/2(2;) are the low-k parts (i.e. k <^ 1/z/) 
of the density fluctuations; the fields 61/2(0;) are given by 61/2(0;) = 7rz/i/2X + 6'i/2(x), with 



Gi/2{,x) = 71 dylli/2{y). These expressions hold for both bosons and fermions. If we use 
this representation in a density-density interaction term U12 J dxni{x)n2{x) , we generate to 
lowest order a term of the shape U12 J dxlli{x)ll2{x) , but in addition an infinite number of 
nonlinear terms, corresponding to all harmonics in the representation. However, only the 
terms for which the linear terms {2nmi/2i^i/2x) cancel, can drive a phase transition. For 
a continuous system this happens for rriiUi — m2i'2 = 0, whereas for a system on a lattice 
we have the condition miUi — m2i'2 = ^3, where mi,m2 and are integer numbers. In 
general, higher integer numbers correspond to terms that are less relevant, because the scaling 
dimension of the non-linear term scales quadratically with these integers. We are therefore 
lead to consider small integer ratios between the fillings and/or the lattice if present. In [69] . 
we considered two cases of commensurabilities: a Mott insulator transition coupled to an 
incommensurate liquid, and a fermionic liquid at half-filling coupled to an incommensurate 
bosonic liquid. In both cases the commensurability occurs between one species and the 
lattice, but does not involve the second species. Here, we consider the two most relevant, i.e. 
lowest order, cases which exhibit a commensurability that involves both species. The first 
case is the case of equal filling ui = 1/2, the second is the case of the total density being unity, 
i.e. z/i + z/2 = 1, where the densities ui and 1^2 themselves are incommensurate. The first 
case can drive the system to a spin-gapped state, the second to a charge gapped state. We 
will determine in which parameter regime these transitions occur, and what type of QRLO 
the system exhibits in the vicinity of the transition. These two cases can be mapped onto 
each other via a dual mapping, which enables us to study only one case and then infer the 
results for the second by using this mapping. We will write out our discussion for the case 
of equal filling and merely state the corresponding results for complementary filling. 
The action of a two-species mixture with equal filling in bosonized form is given by: 

S = Sq^i + 5*0,2 + 'S'12 + Sint- (6) 

The terms Sqj, with j = 1, 2, are given by 

So, = dhQ-{d^e,f + v,{d^e,f) (7) 

Each of the two types of atoms, regardless of being bosonic or fermionic, are characterized by 
a Luttinger parameter K1/2 and a velocity vi/2- Here we integrate over r = {vot^x), where 
we defined the energy scale vq = {vi + V2)/2. The term S'12 describes the acoustic coupling 
between the two species, and is bilinear: 

S12 = ^ [ dhdM.92 + ^ f d^rdrOM. (8) 



The second term is created during the RG flow; its prefactor therefore has the initial value 
^2(0) = 0. We define 5*0 = 5*0,1 + 5*0,2 + 5*12, which is the diagonalizable part of the action. 
Sint corresponds to the non-linear coupling between the two liquids, which we study within 
an RG approach: 

S,nt = j d'rcos{29^-2e2). (9) 




Figure 4: a) Phase diagram of a commensurate FFM or a BBM of hardcore bosons (with the 
replacement TSz^SS), b) phase diagram of a BFM with hardcore bosons, in terms of the 
interaction U12 and the parameter z = \vi — V2\/{vi + V2)- For both attractive and repulsive 
interactions a spin gap opens, except for z = and positive interaction. In the attractive 
regime, a FFM or a BBM shows either singlet pairing or CDW order, or a coexistence of 
these phases, a BFM shows either CDW order or polaron pairing. For repulsive interaction 
all mixtures show SDW ordering, with FFMs and BBMs showing subdominant triplet or 
singlet pairing, respectively, for a large range of z. In the gapless regime, a FFM shows 
degenerate SDW and CDW order, a BFM shows CDW order for the fermions and SF for 
the bosons, and a BBM shows SF with subdominant CDW, i.e. supersolid behavior. For 
very large positive values of U12 the system undergoes phase separation (PS); for very large 
negative values it collapses (CL). 



This bosonized description applies to a BBM, a BFM, and a FFM. Depending on which 
of these mixtures we want to describe we either construct bosonic or fermionic operators 
according to Haldane's contruction [35l [8]: 

f/b = h + n]i/2 J2 e™®e'*. (10) 

m odd/ even 

uq is the zero- mode of the density, ^{x) is the phase field, which is the conjugate field of the 
density fluctuations Il{x). The action for a mixture with complementary filling, z/i + z/2 = 1, 
is of the form Sq + S[^^, where the interaction S[^^ is given by: 

SL = -^2 I d'rcos{2e, + 2e2). (11) 

To map the action in Eq. onto this system we use the mapping: 62^ — O2, <t>2^ — (p2, 
and gi2~^ — gu, which evidently maps a mixture with complementary filling and attrac- 
tive (repulsive) interaction and onto a mixture with equal filling with repulsive (attractive) 
interaction. 

To study the action given in Eq. ([6]), we perform an RG calculation along the lines of the 
treatment of the sine-Gordon model in [56l[27]. In our model, a crucial modification arises: 
the linear combination 61 — 62, that appears in the non-linear term, is not proportional to 
an eigenmode of 5*0, and therefore the RG flow does not affect only one separate sector of 



the system, as in an SU(2)-symmetric system. The RG scheme that we use here proceeds as 
follows: First, we diagonalize 5*0 through the transformation (see [68]) 9i = B161 + B262, and 
02 = D161+D262, where -B1/2 and D1/2 are some coefficients, and 6*1/2 are the eigenmode fields 
with velocities V112. Now we introduce an energy cut-off A on 6'i/2 according to oj"^ /vi/2 + 
Vi/2k'^ < A^. We shift this cut-off by an amount dA, and correct for this shift up to second 
order in gi2. At first order, only gi2 is affected, its flow equation is given by: 

K1-K2 ■ )gi2, (12) 



dl \ TT f 1 + f 2 / 

with dl = dA/A. At second order several terms are created that are quadratic in the original 
flelds 61 and 62- We undo the diagonalization, and absorb these terms into the parameters 
of the action, which concludes the RG step. By iterating this procedure we obtain these flow 
equations at second order in gi2: 



dKi/2 _ gu /o , /^^'2 , Vi 



dl IGvr^ V \vi V2 



(13) 



dl IGvr^ \ Vi V2 

dv 



,2 



2 9l2 (Vl V2\ . . 

dUi2 gl2( , N /-i^N 

^ = (IM + IM) (17) 

dl Sir 

The system of differential equations, Eqns. f|T2|) to f|T7|) . can show two types of qualitative 
behavior: The coefficient g^ of the non-linear term can either fiow to zero, i.e. Si^t is 
irrelevant, or it diverges, leading to the formation of an energy gap. In the first case, the 
system fiows to a fixed point that is described by a renormalized diagonalizable action of the 
type 5*0, from which the quasi-phases can be determined. 

When Sint is relevant, we introduce the fields [17] 9p/^ = -^{Oi ± 62), which define the 
charge and the spin sector of the system. In this regime, these sectors decouple. Each of the 
two sectors is characterized by a Luttinger parameter and a velocity, -ft'p/o- and Vp/a, which 
are related to the original parameters in 5*0 in a straightforward way. Using the numerical 
solution of the fiow equations, we find that K^r — > 0, as can be expected for an ordering of 
the nature of a spin gap, leaving Kp the only parameter characterizing the QLRO in this 
phase. 

In order to determine the QLRO in the system we will determine the scaling exponents 
of various order parameters. The order parameter with the largest positive scaling exponent 
shows the dominant order, whereas other orders with positive exponent are subdominant. 

We will now apply this procedure to the different types of mixtures. For a FFM we find 
that the system always develops a gap, with the exception of the repulsive SU(2) symmetric 
regime (cp. [10]). To determine the QLRO we introduce the following operators [TTl [25]: 




U^^Vg SDW, CDW(SS) U^^Vq SDW, 

Figure 5: a) Phase diagram of a BFM, b) phase diagram of a BBM with the first species being 
in the hardcore hmit, in terms of U12, and the Luttinger parameter of the second species 
{K2), at the fixed velocity ratio l^i — V2\/{vi + V2) = 0.5. For large repulsive interaction the 
system undergoes phase separation (PS), for large attractive interaction the system collapses 
(CL). In the regime below the thick line the system opens a gap, i.e. if species 2 is close to 
the hardcore limit. However, for larger values of K2, the gapless phase is restored. Close to 
the transition, the properties of the fermions, respectively hardcore bosons, are still affected 
by the RG flow, leading to CDW order for the fermions and to supersolid behavior for the 
bosons. 

OsS = J2a,a' ^fR^'^^^yfL^S-a', O^g = J2a,CT' ^fR,(^^a,a'fL:3-a', OcDW = Ha,a' fR,a^^,(^' f L,<t' ■, 

and O^^i^y = Y.a,a' ^fR,cj(^a,a'fL,<T', wlth (T, (t' = 1, 2, = 3-2(j, and a = x,y, z. In the gapless 
SU(2) symmetric regime, both CDW and SDW show QLRO, with both scaling exponents 
of the form asowjCDW = ^ — Kp [17j, which shows that these orders are algebraically 
degenerate. Within the gapped regime the scaling exponents of these operators are given 
by ass,TSz = 2 — and OicDW.SDWz = 2 — Kp. As discussed in [25], the sign of gi2 
determines whether CDW or SDW^, and SS or TS^ appears. In Fig. IHa), we show the 
phase diagram based on these results. In addition to these phases we indicate the appearance 
of the Wentzel-Bardeen instability, shown as phase separation for repulsive interaction and 
collapse for attractive interaction. 

We will now use the dual mapping to obtain the phase diagram of a FFM with complemen- 
tary filling from Fig. |l]a). Under this mapping, the attractive and repulsive regimes are ex- 
changed with the following replacements: CDW^SDW,, SDW.^CDW, SS, TS,-^SDW, 
and SDW^SS. Note that the gapless regime is now on the attractive side, with degenerate 
CDW and SS pairing. 

For BBMs we proceed in the same way as for FFMs. We introduce the following set of 
order parameters: Ocdw = b\bi+blb2, Oss = Osdw, = b\bi-b\b2, OsdWo: = b\b2+blbi, 
OsDWy = —i{b\b2 — b\bi), and in addition the superfluid (SF) order parameters bi and 
62- In Fig. m a) we show the phase diagram of a mixture of a BBM of hardcore bosons, 
which is almost identical to the one of a FFM. The phase diagram of the mixture with 
complementary filling, as obtained from the dual mapping, is also of the same form as 
its fermionic equivalent, with the exception of the gapless regime, in which BBMs show 
supersolid behavior (coexistence of SF and CDW order), and with the replacement TSz^SS. 



In Fig. [5]b), we show the phase diagram of a mixture of hardcore bosons (species 1) 
and bosons in the intermediate to hardcore regime (species 2) . If species 2 is sufficiently far 
away from the hardcore limit, the system remains gap less. However, in the vicinity of the 
transition the scaling exponents of the liquids are affected by the RG flow. As indicated, the 
effective scaling exponent of the hardcore bosons is renormalized to a value that is smaller 
than 1, and therefore we find both SF and CDW order, i.e. supersolid behavior. The 
phase diagram of the dual mixture is of the following form: the attractive and the repulsive 
regime are exchanged, and in the gapped phase we again have the mapping: CDW^SDWz, 
SDW.^CDW, SS^SDW, and SDW^SS. The gapless regime is unaffected. 

For a BFM we find that the order parameters Ocdw, Osdw^^ Of-pp = /ij/LC"^*'^*'' 
[651 [69], b can develop QLRO in the gapless regime. In the gapped regime, the order pa- 
rameters Opp = fRbfib and Opp' = fpl)^ fhb^ in addition to Ocdwi show QLRO. {Opp/ppi 
are special cases of the polaron pairing operators discussed in [651 EH].) In Fig. ID b) we 
show the phase diagram of a BFM with hardcore bosons, and in Fig. [S]a), we vary the 
Luttinger parameter of the bosons. In both the gapless phase and the gapped phase, we find 
that CDW and /-PP or PP, respectively, are mutually exclusive and cover the entire phase 
diagram, cp. [651 EH]. The dual mapping again maps attractive and repulsive regimes onto 
each other. Within the gapped phase we find the mapping CDW^SDW^, SDW^^CDW , 
and PP—*PP', the gapless regime is unaffected. 

Before we conclude, we discuss how these predictions could be measured experimentally. 
CDW order will create additional peaks in TOF images, corresponding to a wavevector 
Q = 2kf. As demonstrated and pointed out in [321 [211 [31 [66], the noise in TOF images 
allows to identify the different regimes of both gapped and gapless phases. As discussed in 
[651 [69] . a laser stirring experiment could determine the onset of CDW order for fermions, 
or the supersolid regime for bosons. RF spectroscopy [12] can be used to determine the 
presence and the size of an energy gap. 

In conclusion, we have studied mixtures of ultra-cold atoms in ID with commensurate 
filling. We used a Luttinger liquid description which enables us to study FFMs, BFMs, and 
BBMs in a single approach. We find that FFMs are generically gapped for both attractive 
and repulsive interactions, whereas for BFMs and BBMs the bosons need to be close to the 
hardcore limit. We find a rich structure of quasi-phases in the vicinity of these transitions, in 
particular a supersolid phase for BBMs, that occurs close to the hardcore limit. Experimental 
methods to detect the predictions were also discussed. 

IV. Phase-locking transition of coupled low-dimensional 
superfluids 

Most phase transitions that have been realized in ultra-cold atom systems are generic first 
or second order transitions. However, the paradigm of phase transitions in two dimensions 
at finite temperature is of a more intricate type, a Kosterlitz-Thouless transition, which is 
characterized by a change of the functional form of the correlation function of the order 
parameter, from algebraic decay to exponential decay. In an intriguing new development 



in studying low- dimensional strongly correlated systems, such a Kosterlitz-Thouless (KT) 
transition [11] was indeed realized and observed [33]. In this experiment the interference 
amplitude between two independent two-dimensional (2D) Bose systems was studied as a 
function of temperature. This analysis revealed the jump in the superfluid stiffness (see 
also Ref. [HH]) and the emergence of unpaired isolated vortices as they crossed the phase 
transition. 

The other focus of this section, the physics of ramping across a phase transition, is 
also triggered by a recent experiment: Sadler et. al. observed spontaneous generation of 
topological defects in the spinor condensate after a sudden quench (i.e. a rapid, non-adiabatic 
ramp) through a quantum phase transition [89]. A similar experiment in a double- layer 
system was reported in Ref. [90]. The topological defects are generated [19] at a density 
which is related to the rate at which the transition is crossed [113j . Later it was argued that 
the dependence of the number of such defects on the swipe rate across a quantum critical 
point can be used as a probe of the critical exponents characterizing the phase transition [SB] . 
This Kibble-Zurek (KZ) mechanism was originally considered as an early universe scenario 
creating cosmic strings, which would serve as an ingredient for the formation of galaxies [50] . 
Cold atom systems appear to be a very suitable laboratory for performing such "cosmological 
experiments", since these systems are highly tunable and well isolated from the environment. 
So far the experiments and the theoretical proposals addressed the KZ scenario across a 
quantum phase transition. The main reason is that it is generally hard to cool such systems 
sufficiently fast to observe non-equilibrium effects. In this work we provide an example of a 
particular system where this difficulty can be easily overcome by quenching the transition 
temperature instead of T. Thus the relevant ratio T/Tc can be tuned with an arbitrary 
rate and the KZ mechanism can be observed. Specifically, we examine a system of two 
superfluids (SF): As we show below, by turning on tunnehng between the two systems the 
transition temperature increases rapidly, and the system attempts to create long-range order 
(LRO). However, in this process, defects in the SF phase are created, which develop into long- 
lived vortex-anti- vortex pairs or in finite system unbalanced population between vortices and 
anti-vortices. We note that because the systems are isolated and there is no external heat 
bath, the temperature itself also changes due to the quench. However, the long-wavelength 
fiuctuations relevant for the KT transition are only a small subset of all degrees of freedom, 
majority of which are only weakly affected by small inter-layer tunneling. So we believe that 
the change of the is the main effect of the quench. 

In this section we consider two SFs coupled via tunneling and/or interactions. In the 
experiments the hopping or tunneling rate between two systems can be tuned to a high 
precision [S2l ESI ESI El] • Interactions between the atoms in different systems can either be 
realized in ensembles of polar molecules or by using mixtures of two hyperfine states, where 
the tunneling rate is controlled by an infrared light source [H], which induces spin-fiipping 
between the hyperfine states. In this case the atoms in different states naturally interact 
with each other since they are not physically separated in space. The main results of our 
analysis are the phase diagrams of coupled SFs in Fig. E] and Fig. [TJ the behavior of and 
the energy gap shown in Fig. [ini as well as the proposal of realizing the KZ mechanism by 
switching on the tunneling between two SFs. 
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Figure 6: Phase diagrams of two 2D SFs, coupled through a term of the form 1S12, Eq. (122|) . 
in terms of Jint/ J and T /Txt- For low temperatures we find antisymmetric quasi-order (AQ) 
and/or symmetric quasi-order (SQ), which either simultaneously undergo a KT transition 
due to single vortices (AQ/SQ to thermal Bose gas (TBG) phase), or individually due to 
correlated vortex pairs: symmetric (anti-symmetric) vortex pairs drive the AQ/SQ to AQ 
(SQ) transition. 

2D superfluids 

In this section we consider two 2D SFs, each characterized by a KT temperature Tj^t- We 
write the bosonic operators 61/2 in the two layers in a phase-density representation [TT], [27], 
bi/2 ~ \/Pi/2 exp(20i/2), where pi/2 are the density operators of the two systems, and 0i/2 
the phases. The low-momentum fluctuations of the phase fields are described by Gaussian 
contributions to the Hamiltonian ?io- Because of the formal analogy between the quantum 
ID and thermal 2D systems [25] we adopt the quantum terminology throughout the paper 
and refer to the ratio of the Hamiltonian and the temperature as the action. Then 



The energy scale J here is related to T^t by J = IT^q^j-n. Besides these long- wavelength fluc- 
tuations, the system also contains additional degrees of freedom, vortex-anti- vortex pairs [11] . 
The corresponding term in the action is expressed through the dual fields 6*1,2 [27] : 



where a is a short-distance cut-off of the size of the vortex core, and A\ is proportional to 
the single-vortex fugacity: A\ ~ J ex.Y>{— J / T) ^ where we assume both SFs to have the same 
effective parameters J and Ai. Operators of the type exp(2z^) create kinks in the field 0: 
exp(— 22^(x))0(a:') exp(22^(a;)) ~ 0(x') -|- 27r9(x — x'), 9(x) being the step function, which 
corresponds to the effect of vortices in the original 2D problem (Ref. [25], p. 92). 

In addition the two systems are coupled by a hopping term ~ t±h\h2 + h.c, which results 
in the following contribution to the action: 




(18) 




(19) 



where the bare value of Jj_ corresponds approximately to t±po. In principle, the hopping 
term is modified by the vortex contributions, however, these corrections are always irrelevant 
under renormalization group (RG). 

For most of the discussion in this paper we use the symmetric and anti-symmetric com- 
binations of 01/2 and 9i/2: 

(j)s/a = (</>! ± <P2)/V2, = (^1 ± ^2)/v^ • (21) 

Written in these fields, the term Sq in Eq. (fT8|) is again a sum of Gaussian models, now in 
the fields 0^ and (pa, with the same energy scale J. However, we will consider a broader class 
of actions, in which the energy scales of the symmetric and anti-symmetric sector differ. We 
include the following term in the action: 

Si2 = c/VV0iV02 (22) 

With this, the quadratic part of the action is given by: 

So + S^2 = ^1 dh{y<Psf + ^ I rfV(V0.)^ (23) 

where Jg and Ja are given by Jg/a = J ± ^int- 

We now motivate the existence of such a term in ultracold atom systems, by con- 
sidering two BECs coupled by a short-range density-density interaction. Starting from a 
Hamiltonian of the form H = Xl/cl^k^k^k + (5'/2V^)PkPk], where is the boson operator, 
ek the free dispersion ek = k^/2m, g is the interaction strength of the contact interaction, 
V the volume, and pk is the density operator of momentum k, given by pk = Xlp^p^p+k; 
we assume that the zero momentum mode is macroscopically occupied, and formally re- 
place the operator feg by a number, Bq — > \/Nq, where Nq is the number of condensed atoms 
which is comparable to the total atom number A^, i.e. Nq ~ A^. Next we keep all terms 
that are quadratic in 6k (with k 7^ 0), and perform a Bogoliubov transformation, given by: 
bk = uiiPii + t'k/^lk! to diagonalize the Hamiltonian. The eigenmodes /5k have a dispersion 
relation cuk = ^/ ^k{^k + "^gn), with n being the density N/V. The low-k limit is given by 
uj^ ~ "y^lkp, with V = gn/m, which corresponds to the contribution in Eq. (fTSl) of the 
action. Next, we consider the sum of two copies of the previous Hamiltonian with boson 
operators bi/2- In addition we consider an interaction H12 = XlkPi kP2,k; where the 

density operators pi/2,k are given by pi/2,k = J2p ^1/2 p^i/2,p+k- Following the same procedure 
as before, we find two eigenmode branches, corresponding to in-phase and out-of-phase su- 
perpositions of the modes of each condensate, with the dispersions u'^^^ ^ ~ i;^^^|kp, with the 

velocities Vs/a = \/(fi' ± gi2)n/'m. Therefore, for this example, the energy scale Jint is related 
to gun/m, which would be of similar order as J for a system interacting via contact interac- 
tion, for small temperatures. This discussion only applies to the weakly interacting limit of 
a true condensate. However, it demonstrate that a density- density contact interaction term 
can lead to a substantial energy splitting of the in-phase and out-of phase modes. 
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Figure 7: Phase diagram, temperature (in units of T^t) versus interaction (in units of J). 
We assume J±/J ~ 10~^ and Ai/J ~ 10~^. DLSF: double layer superfluid; TBG: thermal 
Bose gas; ASF: anti-symmetric superfluid; SQ: symmetric quasi-order. The order of the 
transition lines are either first (I), second order (II), or KT (thin lines). 

Finally, in addition to single vortices in each SF, we have to consider the possibility of 
correlated vortex pairs, i.e. one vortex in each layer at the same location of either the same 
or of opposite vorticity. We will refer to these vortex configurations as symmetric or anti- 
symmetric vortex pairs, respectively. These excitations appear as the following terms in the 
action: 



These correlated vortex terms, which describe new degrees of freedom, can be the most 
relevant non-linear terms in the action, which derives from the possibility that the vortices 
in different layers interact with each other, through the terms fl2Ul) and fl2^ . The effect of 
these terms is the following: At low temperatures the energy between two single vortices 
of opposite vorticity due to tunneling grows as the square of the distance D between them, 
i.e. as J±{D/a)'^. As a result, the tunneling term attempts to confine vortices of opposite 
vorticity, leading to phase-locking between the layers, which we describe further later on. 
The interaction S12 changes the energy of correlated vortex pairs as follows: The energy of a 
single vortex is given by 27rJlogL/a, where L is the system size, whereas a symmetric/anti- 
symmetric vortex pair has an energy of 47r(J ± Jint) logL/a. Therefore, symmetric vortex 
pairs are the lowest energy vortex excitations for Jint < — ^/2, whereas for Jint > J/2 anti- 
symmetric vortex pairs are the lowest energy excitations. As we will see below, in these 
regimes correlated vortex pairs drive transitions to phases, in which one sector is (quasi-) SF 
whereas the other is disordered. We will also see that these terms are generated under the 
RG flow, even if not present at the onset. 

We note that a similar system has been studied in [8]. Here, we consider a larger class 
of systems by including the interaction term ( |22l) . which in turn requires us to include the 
correlated vortex excitations (l2ll) . These terms give rise to additional phases as we will see 
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(24) 



in the following. 

Next we analyze our system within the RG approach. This RG flow is perturbative in 
the vortex fugacities Ai, Ag, and Aa, and the tunneling energy J±, and therefore applies to 
the weak-coupling limit (in particular — +0). At second order the flow equations are 
given by [6]: 

(25) 



dl \ 2TxJa 

"^^'-^2- 24') A, + a,^%-^ , (26) 



dl \ 2- y - 

"^^^-^2- 2n^] Aa + ag^lii:^^ , (27) 



dl V T J ^ 2T'^ 

dAi ( 7r(J, + Jg) AJs + AJa 

^ ^ «3 Tp^ Ax , [Zii) 



dl \ 2T " r2 

- -4 At - -4-AJs + JM), (29) 



dl V47rV„ T4 " 2T4 

^ = -«2(2^Jf + ^(J. + Ja)Js)2J. . (30) 

The coefficients 0:2/3 are non-universal parameters that appear in the RG procedure [56] , 
and which do not affect the results qualitatively. For consistency, we have to expand the 
right-hand site of the above equations up to second order, around the resulting Gaussian 
fixed point: Jg/a = ^ ± ^int + js/a- We emphasize again that Jint near the fixed point can be 
generated by RG and be nonzero even if it is not present at the onset. 

Before we consider the full RG flow, we consider the simpler case of no tunneling, i.e. we 
solve the RG equations while setting J± = 0. In Fig. [6] we show the phase diagram of two 2D 
SFs coupled by 1S12, Eq. fl2^ . Such a system would be realized by a 2D mixture of bosonic 
atoms in two different hyperfine states, interacting via some short-range potential. The order 
parameters we consider are Os{x) = bi{x)b2{x) and Oa{x) = b\{x)b2{x). To obtain the phase 
diagram we consider the correlation functions of each of these order parameters, which can 
either scale algebraically or exponentially. In Fig. [6] we refer to algebraic scaling of Os{x) 
as symmetric quasi-order (SQ), and of Oa{x) as anti-symmetric quasi-order (AQ). In each 
of the sectors a KT transition marks the transition from the algebraic to the exponential 
regime, which occur either simultaneously and are driven by single-vortex excitations, or at 
different temperatures and are driven by correlated vortex pairs. As a result we find four 
regimes: At temperatures above Tkt, both sectors are disordered, giving rise to a thermal 
Bose gas (TBG) phase. For temperatures below Tkt, and for a wide range of Jint, we find 
that both sectors are quasi SF (AQ/SQ), which is the only phase in which the correlation 
function of the single boson operators show algebraic scaling. We also find regimes in which 
only one sector shows algebraic scaling, whereas the other is disordered (AQ and SQ). From 
the perspective of vortices, the TBG phase is a gas of free single vortices in each layer, 
whereas the AQ (SQ) phase is a gas of symmetric (anti-symmetric) vortex pairs. 

We now consider the full RG system, including J±. We numerically integrate the RG 




Figure 8: (a) Critical temperature Tc of the DLSF-TBG transition (in units of Tkt) for 
different values of Ai/J: 10~^,0.1,0.4 (I-III), and for Jint = 0. (b) Energy gap in the anti- 
symmetric sector (in units of J±) as a function of J±/J and temperature (in units of Tkt)- 
We have set Ai/J = 0.1 and J^nt = 0. 



equations, and find the phase diagram shown in Fig. [7] in terms of the temperature T and the 
interaction Jjnf We again find four different phases that are different combinations of LRO, 
QLRO, and disorder in the symmetric and anti-symmetric sector. At high temperatures we 
find that both sectors are disordered in a TBG phase, as before. For lower temperatures, 
and for a wide range of Jint, the system is in a double-layer SF phase (DLSF): The sym- 
metric sector shows algebraic scaling, whereas the exponent of the anti-symmetric sector is 
renormalized to zero, i.e. we find two SFs that are phase-locked due to J±. Note that the 
transition temperature Tc between DLSF and TBG has been noticeably increased relative 
to the decoupled value T/^t, as we will discuss further later on. We also find two additional 
phases, which are partially (quasi-) SF and partially disordered. One of them is the SQ 
phase, as before, whereas the other one (ASF), now shows true LRO in the anti-symmetric 
sector due to J_l, whereas the symmetric sector remains disordered. We note that the generic 
double- layer action that we discuss in this paper does not show a sliding phase [76], for any 
non-zero J±. Either Si or Sa, which is generated by RG, drives the anti-symmetric sector 
to a disordered state, or S± creates true LRO in the field (pa- 

We also use the RG flow to find the order of the phase transitions in the weak-coupling 
hmit that the anti-symmetric sector undergoes, by determining the energy gap using a 
'poor- man's scaling' argument: when the coupling amplitude J±{1*) is of order unity the 
corresponding gap is given by the expression A ~ J_|_ exp(— Z*). From the behavior of A at 
the phase transition we can read off whether it is of first or second order, as indicated in 
Fig. El 

Given the nature of an effective theory, only approximate statements can be made about 
how the different regimes of the phase diagram relate to the microscopic interactions. To 
create the ASF or AQ phase an attraction between the two atom species is needed that is of 
order J, whereas to create the SQ phase, a repulsion of that order would be needed. To detect 
the different phases, one could use the interference method used in [33] to distinguish the 
phase-locked phases (DLSF and ASF), which would show a well-defined interference pattern, 
from the uncorrelated phases. Another approach would be time-of-fiight images: The DLSF 
phase would display a quasi-condensate signature, whereas the other phases would appear 



disordered. However, at the transition from ASF or SQ to TBG, the width of the distribution 
would abruptly increase. 

Kibble-Zurek mechanism 

In this section we discuss how the phase-locking transition found in the previous section 
could be used to realize the KZ mechanism. The defining property of this mechanism is 
the generation of topological defects by ramping across a phase transition, coming from the 
disordered phase. The disordered phase that we propose to use is the TBG phase of the 
decoupled 2D systems, that is, we consider the experimental setup reported in ref. [53] for a 
temperature T above the KT temperature T^t- The ordered phase we consider is the DLSF 
phase, i.e. the phase-locked phase of two coupled SFs. The ramping is achieved by turning 
on the tunneling between the two layers, which can be done by lowering the potential barrier 
between them. For this procedure the critical temperature Tc of the DLSF-TBG transition 
needs to be above the KT temperature of the uncoupled systems. We now show that the 
RG flow indeed predicts such a scenario. In the experiments in Ref. |33], the atoms in 
different layers do not interact with each other. Therefore, it can be expected that Jjnt is 
small, of order J±, which motivates us to discuss the case Jint = here. We note however, 
that the desired scenario of an increased critical temperature, is found for a wide range of 
Jint, as can be seen in Fig. [71 In Fig. [TB] (a) we show how the critical temperature of the 
DLSF-TBG transition behaves, predicted by the RG flow, for different values of Ai. The 
critical temperature shows a sizeable increase, due to the phase-locking transition. Due to 
the perturbative nature of the RG scheme, the RG flow underestimates the effects of the term 
5*1, and predicts a finite jump of the critical temperature when J± is turned on. However, 
to lock the SFs together in the regime slightly above Tkt, J± needs to be at least of the 
order of the vortex core energy, giving rise to a finite slope of Tc instead of a jump. The 
energy gap of this transition is shown in Fig. [161 from which we can see that the transition 
is of first order, in contrast to the second order transition described in I113j . which is 
advantageous because the onset of order is instantaneous rather than continuous. We note 
that the phase diagram was obtained using the assumption that the bare parameters of the 
model, in particular J, do not depend on temperature. This is true only if temperature is 
close to Tkt- Here we find that the ratio Tc/Tkt can be relatively large. In fact Tc/Tkt 
will be always smaller than that shown in Fig [161 (a), however, qualitatively the behavior 
of Tc/Tkt as a function of J± should remain intact. We point out that our results can be 
generalized to a system of > 2 coupled SFs. One finds that the SFs still show a strong 
tendency to phase-lock together. As a result the critical temperature should approximately 
satisfy the equality 7tJ{Tc)N = 2Tc. Thus as A^ increases Tc approaches the mean-field 
critical temperature at which the stiffness J vanishes and we recover the usual 3D result. 

In finite size systems there is another constraint on the minimum value of J±: We consider 
the free energy of a single vortex in the anti-symmetric field: (pa ~ arctan(x/y). For the 
decoupled system we get for the free energy F ~ 2(7rJ — 2T) logL/a, where L is the 
system size. The coupling term gives a free energy contribution F± ~ J±{L/a)'^. In the 
thermodynamic limit, L — * oo, this term diverges faster than the others, which is consistent 



with our finding of LRO in tlie antisymmetric sector. For a finite system, comparing these 
terms gives the estimate ~ J\og{L/a)/ {L/aY, that is required for this order to develop. 
With a system size L/a ^ 10^, that would require J± ~ 10~^J, which, for the setup in [33] . 
would be around 10^s~^. 

As an estimate of the number of domains that would be created, we follow the argument 
in [l9]: The coherence scale of the DLSF phase is given by (J/A)^/^a, which is the scale of a 
Klein-Gordon model with a kinetic energy scale J and a 'mass-term' with a prefactor A/a^. 
The domain size is then given by (J/A)a^, and the number of domains by ~ (A/J)L^/a^. 
As we show in Fig. [I6]b) for J±/J ^ 10"^, we find A/J_l ~ 10"^, and therefore J/A ~ 10^. 
With L/a ^ 10^, we would get Ndom ~ 10^ — 10^, which would generate a similar number 
of vortices. We estimate the vortex-antivortex imbalance by considering the number of 
domains around the periphery of the system, which scales as L/^. If we imagine that the 
phase behaves like a random walk, the total phase mismatch, corresponding to the vortex- 
antivortex imbalance, will scale as \/L/^ ~ ^dim^ which, for L/a ^ 10^, is of the order 
10° - 10^. 

In summary, we propose the following procedure: i) Prepare two uncoupled SFs at a 
temperature T slightly above T^t- h) Switch on the tunneling between the two layers, 
which creates a DLSF phase with a critical temperature higher than T. As a result, one 
should find a number of long-lived vortex-antivortex pairs in the anti-symmetric phase field 
(pa, which would be visible in an interference measurement, at a temperature where there 
would be none in thermal equilibrium. 

In conclusion of the section, we studied the phase-locking transition of 2D superfluids, 
within an renormalization group approach. We find that this transition is accompanied by an 
increase of the transition temperature. We suggest that this effect can be used to probe the 
Kibble-Zurek mechanism in cold atom systems by rapidly changing the ratio T/Tc. When 
we include interactions between the layers we find additional phases, in which either the 
symmetric or the anti-symmetric sector is disordered, and the other sector stays superfluid 
or quasi-superfluid. 

V. Bose-Fermi mixtures in two-dimensional optical lat- 
tices 

In the spirit of engineering many-body systems that are relevant in other fields, we now turn 
to atomic mixtures that resemble qualitatively, i.e. in terms of degrees of freedom of the 
system, electron-phonon systems. In two dimensions, these systems are actively studied and 
prove to be of considerable complexity. In order to study their atomic counterparts, Bose- 
Fermi mixtures in optical lattices, we use the powerful method of functional renormalization 
group equations, with which we can determine their phase diagrams in the weak-coupling 
limit in a systematic fashion. We find a rich competition of phases for both the square lattice 
and triangular lattice geometry that we consider. 

In this section we consider mixtures of one bosonic type of atom and either two fermionic 
types that are SU(2) symmetric or spinless fermions. The Hamiltonian for a mixture on a 



square lattice is given by: 



H = -tf ^ flsfj,s-tb blbj-y^XiJ,fnf^i+fibnb,i) + y^^ |^?7//ri/,i,tri/,ia + -^'^M"'M + ^b/'^M'^/,' '(31) 

{ij},s (ij) i i 

where //^ {fi,s) creates (annihilates) a fermion at site i with pseudo-spin s (s =15 1), b\ 
{bi) creates (annihilates) a boson at site i, Uf^i = J2sfisfi,s {^b,i = b\bi) is the fermion 
(boson) number operator, tf and tb are the fermionic and bosonic tunneling energies between 
neighboring sites, /i/ (/x^) is the chemical potential for fermions (bosons), Ubb is the repulsion 
energy between bosons on the same site, Uff is the repulsion energy between the two species 
of fermions, and Ubf is the repulsion energy between bosons and fermions. The two fermion 
species have been treated as a pseudo- spin- 1/2 index (| and [). The case of spinless fermions 
can be immediately obtained from ( l3Ti) by ignoring one of the spin states. In momentum 
space, the Hamiltonian (l3Ti) is written as: 



■ \ (e/,k - /^/) XI flj^'^ + (efo.k -/ib)&t&k + 

k I s 



^ff ^ ^ , ^ ^ , Ubf 



^=2^ S(e/,k-/i/) 2^/k,Jk,s + (eb,k-/ib)&L^k + — P/,k,TP/,-ka + ^P6,kP^^ >(32) 

where p/,k = Eq,s /k+q.^/k.^ (P6,k = Eq^k+q^k) is the fermion (boson) density operator, 
^b/f,k = — 2t6//(cos fcj; + COS ky), is the bosonic/fermionic dispersion relation. 

We consider the limit of weakly interacting bosons that form a BEC |1U91 W7\ . where 
we assume that the zero momentum bosonic mode is macroscopically occupied, and the 
corresponding operator b^ can be formally replaced by a real number bo where 
Nq is the number of condensed atoms. After this replacement we keep all terms that are 
quadratic in b^ (with k 7^ 0), and perform a Bogoliubov transformation, given by: 6k = 
^k/^k + ^k/^lk' diagonalize the bosonic Hamiltonian. The resulting eigenmodes /3k have 
a dispersion relation given by lu^ = \/e6,k(efe.k + '^UbbUb) , with the low-k limit uJi^ ~ "^^felkl; 
with Vb = \/2tbUbbnb- The parameters Uk and f k are given by: = (tUk + k + Ubbn-b) / (2a;k) 
and vl = (-cjk + efe,k + UbbUb) / . 

The density fluctuations of the bosons are approximated by: pb^k ~ \/No{uk + fk)(/5k + 
P-k), with k 7^ 0. The interaction between bosons and fermions is then given by Ubf^/N^/V X]k('"k+ 
Vv){l3\i, + /5lk)p/,-k- As a next step we integrate out the bosonic modes and use an instan- 
taneous approximation, leading to the following effective Hamiltonian: 

^^eff. = 5^ I (ek - P/) flsh,s + ^P/,k,TP/,-ka + ^^ind.,k P/,k,P/,-k| , (33) 

where the induced potential Mnd.,k is given by: 

K.d.,k = -V^/(l+e'(4-2cosA;,,-2cosy), (34) 

with V given by ^ = Ubf /Ubb, and ^ is the healing length of the BEC and is given by 
^ = ^ytb/2nbUbb- This approach is only valid when Vb ^ f/, so that the fermion-fermion 



interaction mediated by the bosons can be considered as instantaneous. Away from this hmit, 
retardation effects are present. In this case, one has to consider the frequency dependence of 
the interaction exphcitly [55l 11021 1103] . The full effective interaction, including retardation, 
is given by: 



V^nd.(t^,k) 



V 



1 + ^2(4 _ 2 cos - 2 cos ky 



(35) 



and the static limit flMl) is recovered when c^k ^ uj. Equation fl33l) describes the scattering 
of two fermions from momenta ki and k2, that are scattered into momenta ka and k4. 
Momentum conservation at the interaction vertex requires that k4 = ki + k2 — ka, and hence 
the interaction vertex, [/(ki, k2, ka), depends on three momenta. Its bare value from (1551) 
can be written as: 



[/(ki,k2,k3) = f/// + V'ind.,ki-k3 • 



(36) 



For the case with retardation, there is dependence on both the momenta and frequencies of 
the electrons so we have U{ki,k2,k3), with k^ = ki + k2 — k^, where ki = (cu, k). 

Starting from non-interacting fermions, we ask the general question of what new many- 
body phases can emerge when the system is subjected to a given interaction t/(ki, k2, ka). 
Our approach to address this question is the renormalization-group method, described in 
the next section. 



Renormalizat ion- Group Method 

Starting with a microscopic model of interacting electrons on a lattice, the renormalization- 
group (RG) method provides the effective model at a given temperature or energy scale [M] . 
The RG is implemented by systematically tracing out high energy degrees of freedom in a 
region between A and A + dA, where A is the energy cut-off of the problem. In this process, 
the vertex U is renormalized. At the initial value of the cut-off A = Aq, the value of U is 
given by its bare value. For the BFM system we describe here it is given by fl36p . At one 
loop, the RG flow is obtained from a series of coupled integral-differential equations |111] 
for all the different interaction vertices f/(ki, k2, ka). The RG equations read: 

diUi(^i,k2Ms) = - de[GpiGM]Ue(}ii,k2,^Ui(p,kM3)- di[GpeGq,e]Ue(p,k2,qi)Ui(^i,qi,k3) 
-/ di>[GpiGq^i\-2Ui(^x,'Pn2)Ui(f[^2)^2)^^+Ui{p,k-i_,c^^ 

J p,uj 

where i = ln(Ao/A), k = ki + k2 - p, qi = p + k2 - ks, q2 = p + ki - ks, and Gke = 
e(|^k| - A)/ {iu; - {k) with ^k = e/,k - At/ and k = (u, k). 

From the general interaction vertices U{ki, k2, ks), the specific interaction channels, such 
as charge- density wave (CDW), antiferromagnetic (AF), and superconducting (BCS), can 



be obtained: 



yCDW ^ 4f/,(ki,k2,ki + Q), (38) 

V^^ = 4f/.(ki,k2,ki + Q), (39) 
V^""' = f/(ki,-ki,k2), (40) 

where we have used the notation: t/c = (2 — X)t//4, = —XU/A with Xf/(ki, k2, ks) = 
f/(k2, ki, ka), and Q is the nesting vector, Q = (vr, vr). 

In a numerical implementation, one discretizes the Fermi surface into M patches, and 
hence each of the interaction channels ( l38l) , (l39l) , (HOl) is represented by an M x M matrix. At 
each RG step, we diagonalize each of these matrices. The channel with the largest eigenvalue 
(with the caveat that a BCS-channel needs to be attractive to drive a transition) corresponds 
to the dominant order. The elements of the eigenvector are labeled by the discrete patch 
indices around the Fermi surface and the symmetry of the order parameter is given by this 
angular dependence. 

The RG method for interacting fermions has been extended to also include retardation 
effects, as for the case of interacting electrons which are also coupled to phonons in a crystal 
[10211103] . In this case: (i) the interaction vertices also depend on frequencies of the incoming 
and outgoing fermions, so the RG equations are written for given external frequencies and 
the integral over intermediate frequencies can not be done analytically, and (ii) there are 
important self-energy corrections (in particular the imaginary part of the self-energy is non- 
zero). Eliashberg equations for strong-coupling superconductivity has been derived with 
this method [102[ I103j for the case of electrons, with a circular Fermi surface, coupled to 
phonons. This method has also been applied to other electron-phonon problems [99l [M], 
and to mixtures of cold atoms in an optical lattice |55j . 



Phase Diagram and Sub-Dominant Orders 

The microscopic parameters in the Hamiltonian ( l3Ti) determine the initial conditions for the 
RG flow, and the shape of the Fermi surface. With these, we write the RG flow equations and 
solve them numerically. We first discuss the case without retardation. For some parameters, 
we encounter a divergence in the RG flow, indicating the onset of ordering with a gap that is 
in the detectable regime, i.e. larger than 10~^t/. In other regimes, where such a divergence 
is not reached, one can read off the dominant tendency of the RG flow. In Fig. [9] we show 
examples of RG flows as a function of £. In Fig. [9] (a), we show the competition between 
d-wave and s-wave pairing, with d-wave being dominant and s-wave being subdominant. 
In Fig. [9] (b) we show an example with dominant d-wave channel and subdominant AF 
channel. In both cases we find that for short distances (or high energies) CDW fluctuations 
are dominant, giving rise to a state that resembles the findings for high-Tc superconductors 
[371 ESI I105j . In some situations the many-body states are almost degenerate and small 
changes in the initial conditions (that is, changes in the form of the interactions) can be 
used to select one particular ground state. 

With this procedure we determine the phase diagram of the system, which is shown 
in Fig. [ini We now discuss the general features of the phase diagram. In the absence of 



any coupling to the bosons, i.e. for = 0, the system shows s-wave pairing for attractive 
interaction, Uff < 0, and no ordering for Uff > 0, i.e. Fermi hquid behavior, except 
for the special case of half-filling where Fermi surface nesting drives the system to AF 
order for repulsive interactions, and to s-wave pairing (degenerate with CDW) for attractive 
interaction. If we now turn on the interaction to the bosons, this picture is modified in 
the following way: The boundary of the s-wave regime is moved into the regime of positive 
Uff, approximately to a value of Uff where the effective interaction at the nesting vector Q 
between the fermions, Uff + Vind.,Q, is positive, i.e. for Uff ~ V/{1 + 8^^). On the repulsive 
side, and away from half-filling, we find the tendency to form a paired state, either rf-wave 
or p-wave. This tendency becomes weaker the further the system is away from half-filling. 
We typically find a gap in the vicinity of half-filling and further away from /i = we find 
only an increasing strength of the corresponding interaction channel. For the half-filled 
system, we find that for attractive interactions the degeneracy between s-wave pairing and 
CDW ordering is lifted, with s-wave pairing being the remaining type of order. For repulsive 
interactions, we find an intermediate regime of (i-wave pairing, and for larger values of Uff 
we obtain AF order. 
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Figure 9: RG flow for the different effective interactions (in units of tf) as a function of the 
RG parameter / {V/tf = 3 and ^ = 1). a) Uff ftp = 0.5; b) Uff/tf = 1.2. 

The RG approach also allows the extraction of the many-body gaps in the system through 
a "poor man's scaling" analysis of the divergent flow: at the point where the coupling 
becomes of order of tf the scaling parameter i reaches the maximum value ic = ln(tj/A), 
where A is the value of the gap. Hence, A/tf ^ exp{— f^} can be obtained from the RG 
flows such as the ones in Fig. [91 In Fig. [11] we show the gaps of the problem as a function of 
Uff/tf in the half-filled case. One can see that as Uff increases, from negative to positive 
values, the s-wave gap is replaced by a rf-wave gap, and finally for an antiferromagnetic gap. 
As is apparent from this figure, the gap in the (i-wave phase is much smaller than the gaps 
of the AF order and the s-wave pairing, and, furthermore, almost independent of the value 
of Uff. The latter is the case because the Uff term is a pure s-wave contribution to the 
interaction and therefore does not contribute to the (i-wave channel. The (i-wave channel 
has an initial contribution which is entirely due to the anisotropy of the induced interaction. 
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Figure 10: Phase diagram, interaction strength, Uff/tf, versus number of fermions per site, 
n, for a Fermi-Bose mixture in a square lattice in 2D {V/tf = 2, ^ = 1). 

which gives only a small value, and as a consequence only a small value for the gap. The 
value of the gap (in units of tf) can be numerically fitted with a BCS expression of the form 
aexp(— with the parameters a and b given by a = 0.31 and b = 14.2. 
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Figure 11: Many-body energy gaps at half-filling (/i = 0), as a function of Uff/tf, for 
V/tf = 3 and at a fixed value of the coherence length ^ = 1. Dashed line: s-wave gap; 
Continuous line: d-wave gap; Dotted-dashed line: antiferromagnetic gap. The inset shows a 
magnified plot of the d-wave regime. 

For a system of spinless fermions, one can simply suppress one of the spin indices in (1311) 
and fl32l) . In this case there is a major simplification in the problem since Uff is absent: in 
a spinless problem there can be only one fermion per site, as per Pauli's principle. Hence, 
in the absence of bosons, the spinless gas is non-interacting. The bosons, however, mediate 
the interaction between the fermions. Since the fermions are in different lattice sites the pair 
wavefunction has necessarily a node and hence, no s-wave pairing is allowed. In other words, 
in the spinless case the anti-symmetry of the wavefunction requires pairing in an odd angular 



momentum channel. In fact, we find that throughout the entire phase diagram the fermions 
develop p-wave pairing. At half-filhng we find a similar behavior of CDW fluctuations on 
short scales, analogous to the flow shown in Fig. [9l One should point out that in real solids 
the conditions of " spinlessness" behavior is hard to achieve since it usually requires complete 
polarization of the electron gas, that is, magnetic energies of the order of the Fermi energy (a 
situation experimentally difficult to achieve in good metals). However, in cold atom lattices 
this situation can be easily accomplished with the correct choice of atoms. 
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Figure 12: Relevant processes in the two-patch approximation. 

Finally, when retardation is important, the numerical task of solving the RG flow equa- 
tions become much more demanding. In addition to the discretization of the Fermi surface, 
one has to also discretize the frequency (for T = 0), or consider a certain number of Mat- 
subara frequencies (T 7^ 0). This has been done for this Bose- Fermi system only for a fixed 
density of fermions corresponding to one half [55]. In this case the Fermi surface has a 
diamond shape and scattering processes are dominated by the van Hove points (corners of 
the diamond) where the density of states is singular. The Fermi surface can therefore be 
approximated by the van Hove points only [HI] so that he types of relevant processes are re- 
duced, as shown in Fig. [121 Each of the processes still depend on frequencies: gi{uji,uj2,uj3), 
for i = 1,2,3,4. The phase diagram is shown in Fig. [131 Retardation leads to additional 
phases at half-filling and by tuning the lattice parameters, the system undergoes AF (or spin- 
density- wave SDW), (i-wave SC pairing, s- wave-pairing, and CDW. In the limit oi Vb ^ Vf 
discussed previously, when retardation is not important, CDW does not become dominant 
(Fig. [To]) . It is at most degenerate with s-wave pairing for Uff < 0. As the bosons become 
slower, there is stronger tendency for CDW formation (Fig. [T3|) . 

Quantum Frustration in Triangular Lattices 

It is known that the geometric shape of the lattice is a crucial factor in determining the 
properties of interacting many-body systems. For instance, localized spins interacting an- 
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Figure 13: (Color online) Phase diagram for Uff = OAtf, Uhb = O.Stf, and Ub = 2.5. Blue 
circles indicate s-wave SC, red rhombuses indicate d-wave SC, magenta squares AF (also 
called spin-density- wave SDW), and green stars CDW type of ordering. Dashed lines are 
guides to the eye. 



tiferromagnetically on a triangular lattice suffer from the phenomenon of frustration, when 
antiferromagnetic order cannot be achieved because of the particular lattice structure. For 
itinerant fermionic systems, the lattice structure, together with the dispersion relation and 
the filling fraction, determine the shape of the Fermi surface. The Fermi surface, by its turn, 
is a crucial factor in determining what type of orders the system can develop. Indeed, for 
the triangular lattice we consider in this Section, which shows a rich and subtle competition 
between superconducting phases with different symmetries, small changes in the shape of 
the FS determine which pairing symmetry is dominant. This is a reflection of the "lattice 
frustration" on the superconducting phases. In solids, this intriguing lattice geometry is 
realized in materials such as cobaltates [HB], transition metal dichalcogenides [IIU] and k- 
(ET)2X layered organic crystals [13] (if each lattice site is represented by one ET dimer |51j). 
and has been the subject of several theoretical studies [Ml EH HOHl [3 [591 [HI [231 M 

In this section we consider a BFM on a triangular lattice. The geometry of the lattice 
under consideration here is shown in Fig. [TST a). This system is described by a similar 
Hubbard model as for the square lattice. But now, besides the triangular geometry, we 
allow for two different values for the hopping amplitudes, for two types of lattice bonds, 
as indicated in Fig. [15] a) by dashed and continuous lines, tf^a and tb^a with a = 1,2 are 
the fermionic and bosonic tunneling amplitudes between neighboring sites, where the index 
a = 1 (a = 2) refers to the continuous (dashed) bonds. For the description of the isotropic 
case we equate and tf,//,25 and define tf = tj^i = tf^2 and th = tf,^i = tb^2- fJ'f (/^b) is 
the chemical potential for fermions (bosons), Ubb, Uff, and Ubf are the on-site boson-boson, 
fermion-fermion and boson-fermion repulsion energy, respectively. 

Just as for the case of a square lattice (Sec. VII), we consider the limit of weakly 
interacting bosons, in which the bosons form a BEC, for which we use the same description. 
The resulting dispersion relation is now given by = \/ (efe,k — ^b,o)i^b,k — ^b,o + '^UbbUb), 



where the bare lattice dispersion is given by: 



^b,k 



(41) 



For small values of and ky, can be expanded as: uo\^ ~ ^{{2tb,i + h,2)kl + 'ih^2ky)Ubbnbi 

which gives us the two velocities Vb^x = \/ (2tfe,i + tb^2)Ubbnb and Vb,y = \/^tb,2Ubbnb- 

We again assume that these velocities of the condensate fluctuations are much larger 
than the Fermi velocity, which corresponds to the conditions Vb,x/y > tf,i/2- Therefore, large 
bosonic hopping amplitudes, a bosonic density of ~ 1-3, and some intermediate value for 
tf,i/2 "will satisfy this requirement. As before, the bosonic modes can be integrated out, and 
we obtain an approximately non-retarded fermion-fermion interaction. The induced potential 
Mnd.,k is given by: Mnd.,k = -V/{1 + ^^(2 - 2 cos k^) + ^1(4 - 4 cos(A;^/2) cos(\/3fc^/2))) with 
V 

1,2. We again arrive at a purely fermionic, non 



Ubf/Ubb, and are the healing lengths of the Bose- Einstein condensate (BEC) and 

are given by = ^/tb,a/2nbUbb with a 
retarded description of the same form as before. This is the effective model that we study 
with a numerical implementation of the functional renormalization group. For the isotropic 




Figure 14: a) Fermi surfaces for an isotropic lattice, for fij < 2tj i/2, = 2t/,i/2 (hexagonal 
shape), and /i/ > 2tji/2 (six disjoint arcs), b) Diagram of the different types of Fermi 
surfaces that can be created on an anisotropic lattice, by varying the ratio t/,2/^/,i and 
fif. c) Fermi surfaces for tf 2 < for /ij < 4tj2 — 2tji, 4tj2 — 2t/,i < fij < 2tf i, and 
fif > 2ty 1, corresponding to the regimes I-III, respectively, d) Fermi surfaces for tj2 > tf,i, 
for fif < 2tj 1, 2tf i < jif < 4tj2 — 2t^ 1, and jij > 4tj2 — 2t/-_i, corresponding to the regimes 
IV- VI, respectively. 

case, perfect nesting occurs at 3/4-filling, with three possible nesting vectors: Qi = (0, 27r), 
Q2 = (tt, v^vr), and Q3 = (— vr, -s/Svr), leading to three different possible types of instabilities 



per density wave channel. For the anisotropic case, only Qi can be a nesting vector, for the 
condition /ij = 2tj i. To determine the scale of the gaps. A, associated with each of these 
order parameters, we again use a 'poor man's' scaling estimate, specifically: A ^ Aqc"^'', 
where Ic is the point at which the RG flow diverges and the instability occurs. 

The RG is implemented numerically by discretizing the FS into M patches. For the 
results shown in this Section, M = 24 or 36 was used. The CDW, AF and BCS channels are 
diagonalized at each RG step. The dominant instability is the channel that has an eigenvalue 
(divided by the dimension of the matrix) with the largest magnitude (for BCS one has to 
ensure that such eigenvalue is negative so that the channel is attractive). Each element 
of the corresponding eigenvector represents a given FS patch, and hence, the symmetry of 
the dominant order parameter is reflected on the patch (i.e., angular) dependence of each 
element around the FS. Using this method, we determine the phase diagram of the system 
in various limits. 




Figure 15: a) Lattice geometry of the system. The continuous (dashed) bonds correspond 
to the hopping amplitudes t6//,i(2)- For = 4//,2) the lattice is an isotropic triangular 
lattice, b) schematic representation of the AF order corresponding to nesting vector Qi. c) 
+ d) Order parameters of the extended rf-wave orders Di and D2- e) Order parameter of 
the /-wave phase. This order can also be interpreted as two s-wave paired hole states whose 
order parameters are out of phase by vr. f) Order parameter of the extended p-wave phase, 
that appears in anisotropic lattices. 



We first consider spin-1/2 fermions on an isotropic triangular lattice, i.e. with tf^i = 
tf^2 = tf. The FS for such a lattice behaves as follows: For small filling the FS consists 
of one near-circular piece, which then approaches the shape of a hexagon as yU/ approaches 
the special value fif = 2tf. At this special chemical potential, which corresponds to 3/4- 
filling, the FS is nested with the three distinct nesting vectors Qj. For filling fractions larger 
than 3/4 the FS breaks into six disjoined arcs. Examples for these different regimes are 
shown in Fig. [THa). Without coupling to the BEC, the fermions form an s-wave pairing 
phase for attractive interactions, and a Fermi liquid phase for repulsive interactions (ignoring 
high angular momentum pairing phases predicted by the Kohn-Luttinger theorem [58] which 
would occur at energy scales much lower than the experimentally accessible regime), except 
for the specific case fif = 2tf, where the system shows AF order for repulsive interactions. A 
schematic picture of this order is shown in Fig. [T5]b) for the nesting vector Qi. This behavior 
is similar to the one found for isotropic square lattice in the previous Section [67]: s-wave 
pairing for attractive interaction, and Fermi liquid behavior for repulsive interaction, except 
at an special filling, for which we find AF order due to nesting. An interesting difference 
for the triangular lattice is the three-fold degeneracy of the AF phase, an indication of 
frustration. 

When the coupling to the BEC is turned on, the isotropic triangular lattice shows a phase 
diagram of the type shown in Fig. [161 The s-wave pairing phase slightly extends into the 
regime of positive Uff, because of the induced attractive interaction mediated by the bosonic 
fluctuations. The regime that showed Fermi liquid behavior in the absence of the induced 
interaction now shows a rich competition of various types of pairing. In the regime where the 
density is below half-filling, when the FS is approximately circular, the system shows p-wave 
pairing. For fillings larger than 3/4, when the FS consists of six disjoined parts, the fermions 
Cooper pair in a superconducting state with / symmetry. As shown in Fig. (Uje), the FS in 
this regime can also be interpreted as two distinct near-circular Fermi surfaces of holes. In 
this interpretation each of these two fermionic systems is in an s-wave pairing phase, but the 
relative phase between the two order parameters is tt. At 3/4-filling and large values of f//-/, 
the system still shows AF order. However, for smaller values of Uff, and also for smaller 
fillings, two phases with degenerate extended d symmetry develop. These superconducting 
orders have a sizeable g-wave component and are approximately given by: 



These order parameters are shown in Fig. [15] c) and d). The shapes of the order parameters 
are energetically advantageous because, on the one hand, the order parameter maxima are 
located at points at which the system has a high density of states (the 'corners' of the FS). 
Hence, when the superconducting gap opens, there is a large gain of condensation energy 
coming from these regions on the FS. On the other hand, the d-wave state has lower kinetic 
energy than the /-wave, and hence is selected. 

The phase diagram Fig. [16] has a number of similarities to the phase diagram for a BFM 
on a square lattice, such as the s- and the p-wave pairing phase, and the existence of AF 
order for a nested Fermi surface for large Uff. However, the competition of pairing orders 
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Figure 16: Phase diagram of a Bose-Fermi mixture on a 2D isotropic triangular lattice. The 
vertical axis corresponds to the interaction strength, Uff/tf, whereas the horizontal axis 
corresponds to the filling fraction of the fermions per site, n. The other parameters are 
given by V/tf = 3, and = 1 with a = 1,2. 



for positive Uff and intermediate and large filling is much richer, due to the more complex 
shape of the Fermi surface. 

The energy gaps associated with these order parameters can be determined as we did in 
the previous Section [67], by using a 'poor man's' scaling argument. We find for the s-wave 
pairing and the AF order, that they are around O.lTp, where Tp is the Fermi temperature 
of the system. For most of the exotic phases, we energy gaps of the order of 0.01 — O.OOlTp. 

We now consider a BFM with spin-1/2 fermions on an anisotropic triangular lattice, i.e. 
with unequal hopping amplitudes, 7^ ^/(fe),2- The shape of the FS behaves as follows: 

For tf^2 > tf,ii as one increases the chemical potential, the FS first breaks into four arcs 
at yUj = 2tji, and then breaks into six arcs at yUj = 4tj2 — 2tji, corresponding to the 
regimes IV- VI, in Fig. [13] b) and d). For tj 2 < the FS first breaks into two arcs at 
fif = 4tf^2 — 2t/,i, and then breaks into six arcs at /i/ = 2tj^i coresponding to the regimes 
I-III, in Fig. [14] b) and c). At the special chemical potential /x/ = 2tf^i the FS is still nested, 
but there is only one nesting vector along the direction of the bonds with hopping amplitude 
tf^i. In the absence of the coupling to the EEC the phase diagram has a similar structure 
as for the isotropic case: s-wave pairing for attractive interaction, Fermi liquid behavior for 
repulsive interaction, with the exception of the nested FS at /ij = 2tj- i where one finds AF 
order (notice that in this case the filling is not 3/4). 

When the coupling to the bosons is turned on, one generates an even more complicated 
competition of pairing phases for repulsive Uff in the vicinity of the point fif = 2tji, as is 
shown in Fig. [T7] Generally, for unequal hopping the degeneracy between Di and D2 in 
(133]), as well as and Py is lifted: In the regime with > {tf,2 < -^1 (-^2) and 
Px (Py) dominate. For tf^2 > in the intermediate regime, in which the FS consists of 
four disjoined arcs, corresponding to the regime V in Fig. [M] the type of ordering changes 
from Di to /. For tf^2 < the type of pairing also eventually becomes /-wave, but first 
develops two other types of pairing, in the regime II in Fig. [T3] Firstly, one finds an unusual 



extended p-wave symmetry, which is schematically shown in Fig. [15] f). Its wavefunction is 
of the form: 
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The second type of pairing that appears before the system develops /-wave pairing is Di. 
These unusual pairing states are energetically favorable because of the anisotropic shape of 
the FS. For the regime in which the FS has just barely broken up into two arcs, the order 
parameter assumes p-wave symmetry and the maxima are located along the y-axis, where 
the density of states is highest. As the region of open FS widens (see Fig. [I5]f)), this pairing 
becomes energetically unfavorable, and the system develops Di-pairing, so that the maxima 
of the order parameter can again be located near the point of highest density of states. The 
energy gaps associated with these order parameters are of the same order of magnitude as 
for the isotropic lattice. 
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Figure 17: Phase diagram of a Bose-Fermi mixture on an anisotropic triangular lattice. The 
vertical axis corresponds to the ratio t/,2/^/,i, the horizontal axis corresponds to the chemical 
potential /i/. The other parameters are given by V /tf = 3, Uff/tf^i = 2, and = 1 with 
a = 1,2). 

Finally, we consider a BFM with spinless fermions on an isotropic lattice. Due to the 
absence of s-wave scattering between fermions of the same spin state, there is no direct 
interaction, that is, Uff = 0. Hence, in the absence of bosons, the spinless gas is non- 
interacting. The boson fluctuations, however, mediate an induced interaction between the 
fermions. Due to the anti-symmetry of the Cooper pair wavefunction, pairing occurs in 
an odd angular momentum channel. We find a competition between p and /-wave pairing 
symmetry. For small to intermediate filling (n < 0.65), p-wave pairing dominates. For larger 
fillings, for which the FS first approaches the shape of a hexagon and then breaks up into six 
arcs, the system shows /-wave pairing. Since these larger fillings of fermions are typically 
realized in the center of an atomic trap, this result would suggest a comparatively easy way 



to create an exotic pairing state experimentally. In contrast to this, a spinless BFM on a 
square lattice only shows p-wave pairing, since for the quadrangular shape of its FS, channels 
of higher angular momentum are of no advantage energetically. 

The many-body states discussed in this section can be observed through various meth- 
ods: AF order could be revealed in time-of-flight images and Bragg scattering [96], noise 
correlations [32], [21], [S] [66] can be used to detect the various pairing phases, laser stirring ex- 
periments [87] [77] can be used to detect the phase boundary between AF order and pairing. 
The short-scale CDW fluctuations should give a signature in a photo-association measure- 
ment. RF spectroscopy [I2] can be used to quantify the gaps of the various phases. 

VI. Conclusions 

In this article we studied the phase diagrams of various low-dimensional ultracold atom 
systems. In Section III we studied atomic mixtures in one dimension, using Luttinger liquid 
theory. We argued that a Bose-Fermi mixture can be naturally looked at as a Luttinger 
liquid of polarons, and we discussed the rich phase diagrams of commensurate mixtures. 
In Section IV, we studied the phases of two coupled two-dimensional superfiuids at finite 
temperature. We found that that the critical temperature of the phase-locked phase is 
significantly increased over its bare value, which we propose to use for realizing the Kibble- 
Zurek mechanism. When interactions between the two superfiuids are present, we find 
additional phases which are partially superfiuid, and partially disordered. In Section V, we 
used the powerful method of functional renormalization group equations to determine the 
phases of Bose-Fermi mixtures in two-dimensional optical lattices. We found an intricate 
competition of orders, including new types of exotic pairing for triangular lattices. In all 
these sections, ideas how to probe our predictions were also given. 
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